Image denoising assessment using anisotropic stack 

filtering 



Salvador Gabarda and Gabriel Cristobal 

Instituto de Optica, Serrano 121, 28006 Madrid, Spain 



Abstract 

In this paper we propose a measure of anisotropy as a quality parameter to 
estimate the amount of noise in noisy images. The anisotropy of an image can 
be determined through a directional measure, using an appropriate statistical 
distribution of the information contained in the image. This new measure is 
achieved through a stack filtering paradigm. First, we define a local direc- 
tional entropy, based on the distribution of O's and l's in the neigborhood 
of every pixel location of each stack level. Then the entropy variation of 
this directional entropy is used to define an anisotropic measure. The em- 
pirical results have shown that this measure can be regarded as an excellent 
image noise indicator, which is particularly relevant for quality assessment 
of denoising algorithms. The method has been evaluated with artificial and 
real-world degraded images. 

Keywords: Entropy, Anisotropy, Stack filters, Speckle, Synthetic aperture 
radar. 



1. Introduction 



Image anisotropy with respect to a given image feature is the property of 
having a directional dependence. This property is conceptually the opposite 



to isotropy that implies directional uniformity. In a previous paper (Gabarda 



& Cristobal, 2007), we have shown that the entropy calculated in a direc- 



tional way can be used to define a measure of anisotropy that maintains a 
strong correlation with the image noise content. In this paper, a new mea- 
sure of anisotropy is defined for the binary signals generated using the stack 
filtering paradigm. The purpose of such technique is for assessing the qual- 
ity of noise reduction methods. Many image denoising methods have been 
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proposed in the literature. Here we focus this study on a particular type of 



non-linear filters called stack filters. Stack filters (SFs) (Astola, 1997 Coyle 



et al. 1989 Coyle h Lin 1988 ) have been proposed as a useful approach for 



noise reduction with many interesting properties particularly in the case of 
correlated noise. Stack filters have been used with success for different filter- 



ing purposes. Especially interesting is the contribution due to ( Coyle &; Lin 



1988) for introducing a filtering paradigm which minimizes the mean abso- 



lute error between its output and a desired signal, given noisy observations of 
the signal as the filter's input. These results show that optimal stack filtering 
under the mean absolute error criterion is analogous to optimal linear filter- 
ing under the mean squared error criterion. In (Coyle et al. , 1989), structural 



and estimation approaches for images are combined into a methodology that 
provides the best filter from a very large class of generalized stack filters. 
In (Buemi et al. 2010[ ), the behavior of adaptive stack filters on synthetic 
aperture radar (SAR) was evaluated. A classification of simulated and real 
degraded SAR images is carried out using a stack filtering trained with se- 
lected samples. The results of a maximum likelihood classification of these 
data are evaluated and compared with the results using the Lee and the Frost 
classical filtering approach. In this paper, our aim is focused on the use of 
SFs for quality evaluation rather than defining a new image denosing method. 
We define a new measure of anisotropy for the binary signals generated by 
the stack filters paradigm. This measure is used here to define a technique 
for assessing the quality of noise reduction methods in general. This paper is 
organized as follows, Section 2 gives the mathematical background required 
for understanding the proposed measure, Section 3 presents some application 
examples and finally conclusions are drawn in Section 4. 



2. Mathematical background 

2. 1 . Stack filtering 

A recent description of stack filters applied to image processing may be 



found in (Buemi et al. , 2010). SFs present two main properties. The first one 



is threshold decomposition (TD) and the other one is known as the stack- 
ing property (Coyle & Lin, 1988). To underline the threshold decomposition 

is a vector representing a gray- 
We can define 



property let us suppose that X = (x\, x n ) 
scale image where each element Xi corresponds to one pixel, 
a thresholding function T and consider that T^X) is the thresholded binary 
vector determined by this function for a threshold level /. Analogously, Ti(xi) 
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is the thresholded binary value of element x iy defined as TJ(xj) = 1 if Xi > I 
and Ti(x{) = if Xi < I. This relationship implies that the gray-scale im- 
age X can be recovered from the set of binary thresholded images by addi- 
tion, that is, Xi = Y^h=i Ti(xi), where L is the number of possible levels in the 
gray-scale image. The main advantage of a filter F having the threshold de- 
composition property is based on considering that the output of such a filter 
F(X) is the result of three operations, namely a decomposition into thresh- 
olded binary images, secondly it comes a filtering process in this binary state 
and finally an addition of the binary products is performed. The total filter- 
ing process can be summarized as F(X) = J2l=i F ( T i( x ))- Here F i T ii x )) 
represents the filtering operation over the binary image T t (X). This threshold 
decomposition opens up the possibility of realizing Boolean operations over 
the binary products of the image. The stacking property assumes that given a 
filter F and two multilevel input vectors U — (ui, ...,u n ) and V = (vi, ...,v n ), 
the filter F possesses the stacking property if S(U) > S(V) <^> U > V holds. 
SFs have the stacking property, provided that reconstruction of the gray- 
scale image after the binary filtering process is achieved by adding or 1 for 
each pixel position and level. 

For the current purpose, we present here a practical procedure that can 
be applied to 8-bit images. Let us suppose that image X is represented by a 
NxM matrix, where each pixel gray- value is represented by Xk , which is an 
integer number in the range from to 255. In such circumstances, we can 
define a stack of L — 255 binary signals B l (L = 1, L), whose elements b l k 
have a value given by 

b l = { 1 if Xk ~ 1 (1) 
k \ otherwise 

and k — 1, MxN indicate the pixel positions in the image. 

2.2. Anisotropy stack level 

Without lack of generality let us suppose that we identify each of the B l 
signals by B and now we define a dxd (d being an odd number) squared 
matrix Dg , whose elements are all zero except those who have the minimum 
Euclidean distance to the theoretical line with direction 9 in Cartesian co- 
ordinates, referred to the central element of matrix Dg (see Fig. 1 for an 
example). 

After the previous assumptions, let us consider the following expression, 



3 




Figure 1: Different configuration of pixels to define directional niters Dg , with N = 9 
pixels and six equally spaced orientations in degrees from to 150 ( note that periodicity 
is 7r, provided that 180 overlays 0. 



Pj> = -(B*D e ) 



(2) 



It gives a matrix Pf whose elements represent the probability of l's in the 
oriented neighborhood of each homologue pixel in matrix B. Here the symbol 
* indicates the convolution operation. The interpretation of Eq. 2 is straight- 
forward by considering the convolution of a binary image B with an spatial 
filter D. By definition, P(x,y) = \B * D = l d E a s =- a Et=- b D(s,t)B(x + 
s,y + t). Each pixel in B is replaced by a weighted average of l's in its neigh- 
borhood. In Eq. (2), this number represents the average number of ones in 
the diagonal, provided that outside the diagonal all values are zero. Hence, 
P(x,y) stores a number equal to the rate of l's in the diagonal neighbor- 
hood of B(x, y), equal to the probability of l's in such region. Consequently, 
Pq = 1 — Pf is the probability of 0's in the homologue neighborhood and 1 
is a NxM matrix where all its elements are equal to 1. Let call p k { e = pf (£>&) 
and Pq' 9 = p^ipk) the elements of Pf and Pq respectively, a local directional 
measure of entropy can be applied to the binary signals as follows: 



j i=l 



(3) 



This equation follows after applying to our distribution the generalized 



Renyi entropy (Renyi 1976). It is worthy to be noted that the Renyi entropy 
reverts to Shannon entropy (Shannon & Weaver, 1949) when a — > 1. Our 



preference to use the Renyi entopy instead of the Shannon entropy is based 
primarily on its frequent use by researchers on space-frequency image anal- 
ysis based on this approximation. Also the existence of a free parameter a 
gives an interesting flexibility for measuring entropic values. When a — > oo, 
this entropy seems to consider only events with the highest probability. Op- 
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positely, small values of a tend to consider events more equally, regardless of 
their probabilities. Hence, we prefer to use the Renyi entopy rather than the 
Shannon entropy for image processing, due to its generalized character and 
the possibility of using a as a shape controlling parameter. This pixel-wise 
directional entropy can be constrained to a scalar value for the whole binary 
level B by averaging all r k,d values. Hence, 



{r k,e 



> = £»•** ( 4 ) 



Now, the anisotropy A of a binary signal B can be estimated by the 
variation in the set of directional entropies calculated by Eq. 4. We have 
considered here that a suitable statistical parameter to be associated with the 
image anisotropy is the standard deviation of the image directional entropy, 
providing that this parameter correlates well with the amount of variation 



of entropy when measured in different orientations (Gabarda & Cristobal 



2007). Namely 



A = o 



\ 



e=e T 

- Y, (r° - /i) 2 (5) 



where /i = (r ) = ^ Yle=e^ r ° f° r different entropy orientations. Finally, 
note that entropy may be normalized to the interval [0, 1] by multiplying r k ' 9 
by the normalizing constant l/log 2 <i in Eq. 3, provided that < r k,e < 
log 2 d. As we will show in the next section, the measure defined by Eq. (5) 
and the image noise are inversely correlated. This opens up the possibility 
of using this measure as a quality assessment index for denoising algorithms. 

2.3. Anisotropy and image noise content. Experimental results. 

Let consider a test image as the one shown in Fig. 2. This image is 
proposed here as the good quality visual representation of the scene and 
corresponds to a digital gray image coded with 8 bits, 512 by 512 pixels in 
size. By corrupting this image with an increasing amount of Gaussian noise 
we can obtain a set of noisy images whose peak signal to noise ratio (PSNR) as 
presented in Table 1. The PSNR is a common logarithmic measure of quality 
for images. It may be defined through the mean square error (MSE). Given 
two gray-level images X and Y where the former represents the reference and 
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the later is a noisy approximation of the first one, the MSE is defined as: 

M N 

MSE = T7^H 5>(^') " nU)] 2 (6) 



MxN 

i=l j=l 

and from here, the PSNR is defined as 



PSNR = 10 log 



MAX 2 , 
10 v MSE ' 



(7) 



where MAX is the maximum possible value in the test images, i.e.: 255 for 
8 bits images. As usual, we will express PSNR in decibels (dB). 




Figure 2: Test original image ('Boat') 



Applying the stack filtering approach previously described in section 2, 
using an analysis window of 9x9 pixels for Dg in Eq. (2), the six orientations 
indicated in Fig. 1, and a = 3 in Eq. (3), the anisotropy of each stack binary 
level has been measured, attaining the values represented in Fig. 3. 

A second example may be derived from the boat image but corrupting it 
now with different degrees of speckle noise. This is a multiplicative variety 
of noise affecting, for example, Positron Emission Tomography (PET) and 
Synthetic Aperture Radar (SAR) images. The relative quality of the test 
noisy images is indicated by the PSNR values presented in Table 2. Fig. 4 
shows the resulting stack anisotropy by means of a graphical representation of 



6 



Table 1: Gaussian noise test images 



Image 


Boat 


1 


2 


3 


4 


5 


PSNR 


oo 


17,25 


14,59 


13,18 


12,28 


11,66 



0.018 




300 



stack level 

Figure 3: Anisotropy values for the different stack filter levels and different Gaussian noise 
content of boat image. In each level the maximum anisotropy corresponds to the original 
image. 

the evolution in each binary stack level. Again the anisotropy of the original 
image exceeds the values given by the rest of the degraded images. 



Table 2: Speckle noise test images 



Image 


Boat 


1 


2 


3 


4 


5 


PSNR 


oo 


21.86 


18.91 


17.40 


16.46 


15.79 



This experiment was repeated with a third kind of noise, i.e.: impulsive 
noise, with similar results. Table 3 and Fig. 5 summarize such results. In this 
case the differences from the original image to the noisy versions are smaller. 
This justifies the fact that impulsive noise can be more easily removed from 
images than Gaussian or speckle noise, e.g.: by median filters. The method 
has been statistically tested with the 36 real world digital images database 
used in [1] in order to determine its generality. The method has been ap- 
plied following the same scheme used with the previous individual examples. 
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0.018 




300 



stack level 

Figure 4: Anisotropy values for the different stack filter levels and different speckle noise 
content of boat image. In each level the maximum anisotropy corresponds to the original 
image. 



Average results are shown in Table 4 and Fig. 6 for the speckle noise case, 
but similar results have been observed with Gaussian and impulsive noise 
degradations. 



Table 3: Impulsive noise test images 



Image 


Boat 


1 


2 


3 


4 


5 


PSNR 


oo 


19.27 


16.41 


14.73 


13.57 


12.68 



Table 4: Set of 36 speckle noise test images (average) 



Image 


Database 


1 


2 


3 


4 


5 


PSNR 


oo 


22.43 


19.78 


18.28 


17.24 


16.44 



This anisotropic measure can be globalized for a gray-value image by 
considering the area under the graphical representation of the anisotropy. If 
in each level I of the stack the anisotropy A 1 is defined as in Eq. (5), then 



255 



i=i 
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250 300 



stack level 



Figure 5: Anisotropy values for the different stack filter levels and different impulsive noise 
content of boat image. In each level the maximum anisotropy corresponds to the original 
image. 
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Figure 6: Averaged anisotropy values for the different stack filter binary levels with differ- 
ent speckle noise content of a database of 36 real-world digital images. In each level the 
maximum anisotropy corresponds to the averaged anisotropy of original images. The test 
shows how anisotropy monotonously decreases with increasing speckle noise as a general 
rule. 



will measure the anisotropy for the whole image. The practical rule that 
may be derived is the following: given a set of registered images of the same 
scene, the one showing the maximum value for A G is the preferred noise- 
free representation. The quality index we propose here, based on this rule, 
is able to classify images within the same context in terms of their degree 
of noisiness. The higher the index, the lesser the presence of noise in the 
image. This quality index may be expressed also as a noise estimation in- 
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dex, by considering the inverse value of Eq. (8), but as it was defined it 
provides an easily to interpret quality index. In general, we can expect that 
this behavior will be followed by any kind of isotropic noise, as our experi- 
ments have confirmed. Other kind of noise, e.g. with directional patterns, 
may modify the anisotropy of the image but it will not necessarily diminish 
its value. We can compare different results from different denoising algo- 
rithms and determining the less degraded image according to its anisotropic 
value, but some constraints must be considered. We assume that the original 
noise is isotropic (random) and the residual noise together with the possible 
distortion introduced by the denoising method are also random. 

As a real-world situation, the next example illustrates the evaluation by 



this technique of four different speckle noise reduction methods: Frost (Frost 
et al.[ 1982), Kuan (Kuan et al. 1987), relaxed median filters (Ben Hamza 



et al. 



1999[ ) and SRAD QYu fc Acton]|2002fl . The test image is the gray-scale 

The anisotropy measures 
From the figure we 



8-bit 800x800 pixel SAR image shown in Fig. 7. 
using the stack filtering approach are shown in Fig. 
grasp an intuitive impression of the enhancement produced by the different 
denoising methods. Table 5 gives the global evaluation Ac of the different 
outcomes obtained by applying the anisotropic index defined in (8). The 
second row in Table 5 shows the percentage of enhancement due to each 
noise reduction method. 




Figure 7: Example of a SAR image. This image represents a satellite SAR image degraded 
by speckle noise. Image courtesy from B.Brower (ITT Industries) 
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Table 5: Real world speckle noisy image 



Image 


input 


Rmed 


Frost 


SRAD 


Kuan 


A G 
%AA G 


0.67 



0.71 
5.97 


0.73 
8.96 


0.76 
13.43 


0.77 
14.93 




Figure 8: Averaged anisotropy values for the different stack filter binary levels for different 
speckle noise reduction methods applied over the test image shown in Fig. 7. The four 
methods are much alike but there are some differences. The areas under the curves are 
used as a quality index (see Eq. (8)) for each process and these values are compared in 
Table 5. 



3. Conclusions 

In this paper a new anisotropic no-reference measure for image denoising 
assessment has been introduced. Stack filters provide a binary partial rep- 
resentation of the information content of an image. We have presented here 
some experimental results indicating that anisotropy decreases with when 
noise increases in all binary levels of stack filters. This provides a new qual- 
ity assessment tool for noise reduction algorithms. By measuring anisotropy 
as a function of the stack levels we have defined a quality assessment index 
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for images. This anisotropic measure is able of handling the image informa- 
tion in an analytical way that may be valuable for future applications as, 
for example, image fusion methods. By this anisotropic measurement model, 
differences on quality at different image gray-levels may be determined, in- 
dicating which pixels have to be selected in the fusion process from two or 
more images, according to their particular anisotropic values. Further work 
will consider how this global anisotropic measure may be converted to a local 
measure for developping new filtering methods for image denoising and to 
study the combined influence of blur and noise. 

Acknowledgments 

This research has been partially funded by the Spanish Ministry of Science 
and Innovation from the pro jects TEC2010-20307 and TEC2010-09834-E. 

References 

Astola, J. (1997). Fundamentals of Nonlinear Digital Filtering. Boca Raton, 
FL: CRC Press. 

Ben Hamza, A., Luque-Escamilla, P., Martinez- Aroza, J., & Roman- Roldan, 
R. (1999). Removing noise and preserving details with relaxed median 
filters. Journal of Mathematical Imaging and Vision, 11, 161-177. 

Buemi, M. E., Jacobo, J., & Mejail, M. (2010). SAR image processing using 
adaptive stack filter. Pattern Recognition Letters, 31, 307-314. 

Coyle, E., & Lin, J.-H. (1988). Stack filters and the mean absolute error 
criterion. IEEE Trans. Acoust. Speech Signal Process., 36, 1244-1254. 

Coyle, E., Lin, J.-H., & Gabbouj, M. (1989). Optimal stack filtering and the 
estimation and structural approaches to image processing. IEEE Trans. 
Acoust. Speech Signal Process., 37, 2037-2066. 

Frost, V., Stiles, J. A., Shanmugan, K. S., k Holtzman, J. C. (1982). A 
model for radar images and its application to adaptive digital filtering of 
multiplicative noise. IEEE Trans, on Pattern Analysis and Machine Intell, 
4, 157-166. 



12 



Gabarda, S., & Cristobal, G. (2007). Blind image quality assessment through 
anisotropy. J. Opt. Soc. Am. A, 24, B42-51. 

Kuan, D. T., Sawchuk, A. A., Strand, T. C, & Chavel, P. (1987). Adaptive 
restoration of images with speckle. IEEE Trans, on Acoust. Speech Signal 
Proc, 35, 373-383. 

Renyi, A. (1976). Some fundamental questions of information theory. In 
P. Turan (Ed.), Selected Papers of Alfred Renyi chapter (Originally: MTA 
III. Oszt. Kozl., 10, 1960, pp. 251-282). Budapest: Akademiai Kiado. 

Shannon, C, & Weaver, W. (1949). The Mathematical Theory of Communi- 
cation. Urbana, Chicago, London: The University of Illinois Press. 

Yu, Y., & Acton, S. T. (2002). Speckle reducing anisotropic difusion. IEEE 
Trans, on Image Proc, 11, 1260-1270. 



13 



